Content Importance Models for Scoring Writing From Sources
نویسندگان
چکیده
Selection of information from external sources is an important skill assessed in educational measurement. We address an integrative summarization task used in an assessment of English proficiency for nonnative speakers applying to higher education institutions in the USA. We evaluate a variety of content importance models that help predict which parts of the source material should be selected by the test-taker in order to succeed on this task.
منابع مشابه
Developing an Analytic Scale for Scoring EFL Descriptive Writing
English language practitioners have long relied on intuition-based scales for rating EFL/ESL writing. As these scales lack an empirical basis, the scores they generate tend to be unreliable, which results in invalid interpretations. Given the significance of the genre of description and the fact that the relevant literature does not introduce any data-based analytic scales for rating EFL descri...
متن کاملInvestigating neural architectures for short answer scoring
Neural approaches to automated essay scoring have recently shown state-of-theart performance. The automated essay scoring task typically involves a broad notion of writing quality that encompasses content, grammar, organization, and conventions. This differs from the short answer content scoring task, which focuses on content accuracy. The inputs to neural essay scoring models – ngrams and embe...
متن کاملUsing Analytic Scoring Rubrics in the Automatic Assessment of College-Level Summary Writing Tasks in L2
Assessing summaries is a demanding, yet useful task which provides valuable information on language competence, especially for second language learners. We consider automated scoring of college-level summary writing task in English as a second language (EL2). We adopt the Reading-forUnderstanding (RU) cognitive framework, extended with the Reading-to-Write (RW) element, and use analytic scoring...
متن کاملExploring Novice Raters’ Textual Considerations in Independent and Negotiated Ratings
Educators often employ various training techniques to reduce raters’ subjectivity. Negotiation is a technique which can assist novice raters to co-construct a shared understanding of the writing assessment when rating collaboratively. There is little research, however, on rating behaviors of novice raters while employing negotiation techniques and the effect of negotiation on their understandin...
متن کاملTwo Collaborative Feedback Models in EFL Writing Instruction: Do They Make a Difference?
Research in L1 writing has found numerous benefits of employing collaborative learning in the classroom. The research findings on group work provide clear evidence that engaging learners in group activities increases opportunities for students to engage in the negotiation of meaning, which further leads to better acquisition. The present study, implementing two different collaborative feedback ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014